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Abstract 

The purpose of this study was to examine the progress of a class of third- and fourth-year 
undergraduate science students as they attempted to create a knowledge building community in a 
blended or hybrid science education class. The research sought to examine this process through 
analyses of the frequency of their note postings and responses, and through a social network 
analysis of their communication patterns for note reading. These data were automatically 
harvested by the Knowledge Forum knowledge building environment, and downloaded for later 
analysis. 

Contribution levels indicated that the frequency of note postings increased three-fold following 
the mid-term of the course causing maladaptive student work patterns to reduce information 
overload. As well, the disparity between high-frequency note posting students and low-frequency 
note posting students followed a linear curve with the ratio between the highest posting and 
lowest posting student to be 2.7:1. A similar pattern was found with regard to responses. 

A disparity was also found among the students in the number of postings read, with the highest 
note reading student reading six times the number of notes as the lowest note reading student.The 
social network analyses revealed evidence of community formation in the note reading network. 
Analysis showed both one-way and reciprocal interactions, indicating that the pathways needed 
for the transfer of complex information were present. 

Considering all the data together, while some communication patterns necessary for a knowledge 
building community were present, contribution patterns suggested that a true knowledge building 
community did not form, but that there was progress towards it. 

Keywords: Knowledge building, Knowledge Forum, online facilitation, online courses, social 
network analysis, data mining. 
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Resume 

Cette etude avait pour objet d’etudier la progression d’un groupe d’etudiants en sciences de 
troisieme et de quatrieme annees du premier cycle universitaire dans leur tentative de creer une 
communaute d’apprentissage dans une classe hybride d’etude des sciences. Cette recherche visait 
a etudier le processus a partir de 1’ analyse de la frequence d’affichage et de reponse aux notes de 
la part des etudiants, et de l’analyse de leurs habitudes de communication lors de la lecture de 
notes. Ces donnees etaient recueillies automatiquement par l’environnement de partage des 
connaissances Knowledge Forum et telechargees pour des analyses ulterieures. 

Les niveaux de participation indiquaient que la frequence des affichages de notes augmentait du 
triple apres la mi-session, entrainant une reduction de la surcharge d’information dans les 
habitudes de travail sources d’une mauvaise adaptation chez les etudiants. De plus, la disparite 
entre les etudiants qui affichaient frequemment et les etudiants qui affichaient peu suivait une 
courbe lineaire selon le rapport 2,7 :1. Le profil des reponses aux notes presentait une tendance 
similaire. 

On observait egalement une disparite entre les etudiants du point de vue du nombre d’affichages 
lus, ou les etudiants dont la frequence de lecture etait plus elevee lisaient six fois plus 
d’affichages que les etudiants dont la frequence de lecture etait moins elevee. Les analyses du 
reseau social ont revele des formations communautaires dans le reseau de lecture des notes. 
L’analyse a demontre des interactions tant a sens unique que reciproques, indiquant que les 
canaux necessaires a la transmission d’informations complexes etaient presentes. 

Compte tenu de l’ensemble de ces donnees, malgre la presence de certaines habitudes de 
communication necessaires a la formation d’une communaute d’apprentissage, les tendances 
observees dans la participation suggerent qu’une veritable communaute d’apprentissage ne s’est 
pas formee; neanmoins, elles denotent une progression en ce sens. 


Introduction 

One of the commonplace beliefs of teaching at all levels is that if the work assigned is not 
marked, it is not done. This includes class assignments like readings, as well as attendance at 
class meetings. Yet there is evidence that when students attend and do the assigned tasks, they 
perform better (Hovell & Williams, 1979; Wong & Wong, 1979). In terms of online work, 
evidence suggests that students who participate more do better overall (Davies & Graff, 2005; 
Nagel, Blignaut, & Cronje, 2009). These results indicate that participation in the online portion 
of a course enhances learning. 

Another concern in online education (Bielaczyc & Collins, 2005; Hewitt, 1996; Palloff & Pratt, 
2001; Scardamalia & Bereiter, 1994) is the formation of a supportive online community. Many 
students in university undergraduate science classes have never been in classes in which 
community was encouraged, and are also quite isolated because of their competition for the 
marks needed to get into graduate or professional schools. 

These two factors, taken together, indicate that forming a community in an online learning 
environment can be difficult with undergraduate science students. This study examines the 
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progress made towards the formation of a knowledge building community made by students in a 
third-year science education class who worked in a blended class. Machiavelli noted that people, 
. .do not readily believe in new things until they have had a long experience of them,” 
(1532/1998, p. 24) and instructors in such courses need to know what degree of progress is 
realistic to expect from these students. It is hoped that studies such as this will help establish a 
baseline for comparison of classes at this level. 

Learning Online 

Allan and Seaman (2005) give four categories of courses based on the online content: traditional 
courses having no online content, courses having web-based content that basically supplements 
the traditional approach, blended (also called hybrid) courses that have both a traditional 
component and online discourse, and fully online courses with no traditional component at all. 
The course described in this paper was a blended course, in which online participation counted 
for 40% of the final mark. The traditional lecture component was held weekly for two hours in a 
regular classroom, not a computer lab. 

Blended courses have become increasingly popular in recent years (Horn & Staker, 2011). In 
2000, there were approximately 45,000 K-12 students using online learning and by 2009, there 
were in excess of 3 million K-12 students taking courses online, with most of the growth being 
attributed to the blended approach (Horn & Staker, 2011). Strickland (ScienceDaily, 2008) notes 
that the benefits of blended classes include, “.. .increased classroom size, accessibility of material 
and flexibility, but noted that motivation and technological ability are major factors in the 
success of a student in a blended environment” (p. 1). 

Another dimension upon which online learning can be measured is the level of interactivity 
among the students that the online system allows. Allan (2004) notes that the early online 
learning systems were largely based on traditional distance education models and lacked the 
ability to provide interactivity among students. However, newer models of online learning have 
leaned more towards “the formation of social networks and communities, the emphasis on 
creation rather than consumption, and the decentralization of content and control” (Downes, 
2007, p. 19). The emphasis on the formation of community is echoed by Palloff and Pratt (2001) 
who note that “Teaching in cyberspace requires attention needs to be paid to developing a sense 
of community in the group of participants in order for the learning process to be successful” (p. 
20). However, one problem for instructors is how to tell that a community has formed and is 
functioning properly. Failing this, events like flame wars in which students post IN ALL CAPS 
TO SIMULATE SHOUTING can erupt, disrupting the learning process (Palloff & Pratt, 2001). 

Assessment and Online Learning 

Critics of online classes demand proof that online classes provide the same kind of quality as 
traditional classes (Camevale, 2001). New forms of assessment are being developed partly in 
response to this concern. Often these assessments are almost identical to old forms of 
assessment, but are ported to the online environment. An example is online multiple choice tests. 
However, researchers have not restricted themselves to new versions of older forms; some have 
suggested that continuous assessment is possible and desirable (Chung, Shel, & Kaiser, 2006). 
This approach values formative assessment over summative. 
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One factor in online discourse is that it does not follow the rules of traditional discourse. 

Whereas in a traditional class, the teacher chooses who can speak and when, online comments 
can be made by anyone at any time; discussions become less hierarchical and more democratic. 
This allows for what Allan (2004); Higgins, Koktsaki and Coe (2011); and Palloff and Pratt 
(1999) call feedback and what Scardamalia (2002) calls embedded and transformative 
assessment. 

This feedback should come as much from the students as from the instructor (Palloff & Pratt, 
1999). Palloff and Pratt (1999) state that online discourse should include, “constructive and 
extensive” feedback among students (p. 123). Such critical feedback can reveal gaps in learning, 
or misunderstandings. Effective feedback can provide deep interactions that create points of 
connection among students and allow for alternate perspectives on ideas (p. 124). 

Data that are logged by online environments can be used to examine student interactions. This 
can include measures of log-in or contribution frequencies (Allan, 2004), or it can include more 
sophisticated analysis such as social network analysis, a form of analysis in which interactions 
among individuals can be mapped to reveal the patterns of interaction. These patterns can reveal 
a great deal about the information flow within a community (Allan, 2004). 

Social Network Analysis (SNA) and Other Measures 

Social network analysis (SNA) is a form of quantitative analysis that focuses on the relations 
among individuals in a community (Marin & Wellman, forthcoming). An established discipline 
in the social sciences (Degenne & Forse, 1999; Scott, 1991; Wasserman & Faust, 1994), its 
application to education is more recent (Allan, 2004; Hakkarainen & Palonen, 2003; 
Hakkarainen, Palonen, Paavola, & Lehtinen, 2004; Lipponen, Rahikainen, Fallima, & 
Hakkarainen, 2003; Philip, 2009; Sha & van Aalst, 2005). Krebs (2007) has created a short 
introduction to social network analysis that can be found here: http://www.orgnet.com/sna.html . 

SNA can be useful in assessing 21 st century skills, including communicating and elaborating; 
collaborative skills such as teamwork and leadership; and working productively with others 
(Crane et al., 2005; Partnership for 21st Century Skills, 2008). Palloff and Pratt (1999) refer to 
collaborative online interactions among students as creating, “a web of learning” (p. 6) and SNA 
can be used to capture critical aspects of this web. 

In SNA, data are collected about the frequencies with which individuals in a group interact. 

These interactions can be of various types depending on the kind of study being performed. In 
the case of Enron, SNA has been used to examine e-mail contacts among the employees to 
analyze who was part of the conspiracy to commit fraud (Ehrenberg, 2011). Multiple types of 
interactions have also been studied to examine terrorist networks (Mathiesen, 2006; Memon & 
Larsen, 2006). In this study, data were collected on who read whose notes because note reading 
is important in spreading ideas for community discourse (Palloff & Pratt, 1999). 

Once the data are collected, a number of statistical measures can be used to examine the 
interaction patterns. One of the most common analysis techniques is to create a sociogram, a 
kind of network map in which actors in the network are represented as nodes (often dots or 
squares) and the interactions among them as connecting lines (Degenne & Forse, 1999; Yalente, 
2010). Such network graphics can be useful, and Cross, Borgatti, and Parker (2003), in analyzing 
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social networks in business settings, note that, “Simply reviewing [sociograms of business 
communications] with managers usually results in myriad recommendations, as people immersed 
in the patterns of relationships define and resolve issues affecting group performance. In short, a 
picture really is worth a thousand words" (p. 275). 

One of the key concepts in SNA is centrality. While various types of centrality have been 
defined (Valente, 2010), they all share one key idea: the frequency of interactions with an 
individual indicates their importance or influence in a network. As the centrality of the individual 
increases, the more they influence the flow of information through a community. Ideally, in an 
online community, centrality should be quite even, with individuals contributing equally to the 
flow of information. However, in practice, some networks show different patterns. 

Boutillier (2009) gives a typology of nine different common network patterns ranging from 
perfect equality to perfect dictatorship. Online learning communities would ideally look more 
like the perfect equality network than the perfect dictatorship (although some online education 
models do tend to resemble the perfect dictatorship model). An example of the latter would be 
virtual schools that provide materials and programs tailored to individual students, but that 
assume the students will work in isolation from one another. The Florida Virtual Schools operate 
in this manner (http://www.flvsft.com) . While there is collaboration among the teachers, none is 
mentioned among the students. 

In this study, indegree centrality is used for the social network analysis portion. This is a 
measure of how many times a student’s postings have been read or responded to by others, and is 
considered to be related to the amount of information an individual receives (Buskens, 1998). 
Indegree centrality is one of the most commonly used and well understood centrality measures 
(Wellman, Koku, & Junsinger, 2006), and is robust to missing data (Valente, 2010). The term 
“missing data” refers to data from non-participants in the study, or individuals whose data is 
unavailable for other reasons. 

Other measures of used in SNA include the frequency of note postings by individuals and the 
number of notes posted each day by the class as the course progresses. These data were 
downloaded, imported into other programs for further analysis. Social network analyses, and 
posting frequencies can be used to provide timely feedback to the students, allowing them to 
adjust their work habits accordingly. Specifically this study two social network measures were 
used: sociograms based on indegree centrality of the note reading network and the response 
network; and the number of notes posted, number of notes read, and number of responses created 
were visualized as column graphs. Although these data were imported into other programs (e.g., 
UCInet and Netminer II for social network analysis and Excel for graphing) for researcher 
analysis, the students had the same data as sociograms and graphs in the built-in suite of analysis 
tools in Knowledge Forum (see below). The students were taught how to use these and could 
examine the data at any time. 

As noted earlier, it is important for instructors teaching online courses to foster the formation of 
an online community. In this case, the instructor decided to proceed in the manner of a 
knowledge building community. Details of this are provided in the next sections. 
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Knowledge Building and Knowledge Forum 

Blended learning models are becoming an important part of learning (Horn & Staker, 2011; 
Stansbury, 2009). There is also evidence that online learning enhances students’ education 
(Kassop, 2003). As well online learning is growing rapidly and it is likely that the science 
education students will be asked to teach online in the near future (Christensen, Horn, & 

Johnson, 2008; Papemy, 2009), so exposure to online learning would benefit the students. For 
these reasons, it was desirable to add an online component to the traditional lecture format of the 
course. Arguably, one of the more successful models for online learning for the 21 st century is 
the knowledge building paradigm developed by Scardamalia and Bereiter (2003), and this was 
the model chosen for this class. 

Scardamalia and Bereiter (2003) define knowledge building as: 

... the production and continual improvement of ideas of value to a community, through 
means that increase the likelihood that what the community accomplishes will be greater 
than the sum of individual contributions and part of broader cultural efforts. Knowledge 
building, thus, goes on throughout a knowledge society and is not limited to education, (p. 
1371) 

According to Scardamalia and Bereiter (2003), traditional teaching and learning seeks to 
disseminate the cultural capital of a society to students; knowledge building attempts to increase 
the stock of cultural capital. Knowledge building does this by the continual improvement of 
ideas, circulated through the community in a pubic space (often online.) The ideas are placed in 
the public space so that they are available for others to work on, elaborate, and provide 
alternates. According to Fleck, (1939/1981) these ideas circulate within the community, and, 
“After making several rounds within the community, a finding often returns considerably 
changed to its originator, who reconsiders it himself in quite a different light” (p. 45). 

In academia, the communities charged with producing new knowledge are research communities 
and these are often used as a model of a knowledge building community. Students often work to 
produce new understandings of knowledge, one form of new knowledge (Scardamalia & 
Bereiter, 2000). Much of the work of a research organization also involves trying to create an 
understanding within the group of the work of other researchers, which is an essential step to 
new knowledge creation. The online knowledge building environment, Knowledge Forum™, has 
been created by Scardamalia and Bereiter to facilitate the knowledge building process and is 
described in the next section (Scardamalia, 2004). 

Knowledge Forum 

Knowledge Forum is the second generation of the CSILE (Computer Supported Intentional 
Learning Environment) project, and is an online environment designed to support the knowledge 
building process (Scardamalia, 2003). In most settings, the deep underlying cognitive processes 
of learning and knowledge building are invisible and often not recognized by those engaging in 
the processes. Knowledge Forum makes those processes transparent to the students by providing 
supports for the advanced cognitive processes that lead to knowledge building. Space does not 
permit a more thorough discussion of Knowledge Forum (KF) here. An introduction and 
demonstration of KF is available at http://www.knowledgeforum.com/Kforum/products.htm ; it 
will provide more complete information to the interested reader. 
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Relevant to this study is that Knowledge Forum has an evolving suite of online tools that 
students and instructors can use to provide formative assessment (feedback) at any time during 
the course. These include a contributions tool and a social network tool. The students were 
introduced to the social network tools (note reading and responses networks) and contribution 
tools (number of note posted, number of notes read, and number of responses created) and 
instructed to use them to monitor their progress as often as they wished. 

Methodology 

Community formation was analyzed using social network analysis (SNA) by gathering data from 
Knowledge Forum. As noted by Cross, Borgatti, and Parker (2003), work in online environments 
has an invisible quality. Social network analysis allows us to make this invisible work visible and 
susceptible to analysis. The overarching purpose of this study was to examine the progress the 
students made towards creating a knowledge building community. 

The SNA data were triangulated with other quantitative data also obtained from Knowledge 
Forum, among these being contribution frequencies, and the rate of growth of the online database 
through measuring the daily postings. Triangulation of data obtained from online classes is 
necessary because they can otherwise be misinterpreted. For example, the note reading network 
can be influenced by the number of postings in a given time period. If a large number of notes 
are posted in a short space of time, but reading continues at a normal pace, the ratio of notes read 
to new postings will go down. This can give a false impression that the students are not working 
when in fact they are 

Social network data were analyzed using the UCINET program (Borgatti, Everett, & Freeman, 
2002). The numbers of note postings and the daily note contributions were obtained and 
analyzed using Microsoft’s Excel spreadsheet. 

The Class 

The course selected for this study was a third year, undergraduate class for science students 
interested in exploring careers in science teaching. The course was originally designed using the 
lecture method. In this study, the Knowledge Forum was an added component to the course. 
Work in KF constituted 40% of the final mark, ensuring there was a considerable grade incentive 
to participate in the KF. Further demographic and other information about the class can be found 
in Exhibit 1 (http://www.cilt.ca/index.php/cilt/article/downloadSuppFile/571/4) . 

The challenge for the instructor was to get the students to put aside competitive behaviour and 
engage in the kinds of supportive behaviours consistent with the formation of a knowledge 
building community, and to do so in an unfamiliar online knowledge building environment. 

Participants 

The participating students were third- and fourth-year undergraduate science students. They 
ranged in age from twenty to twenty-three years, and 80% were women. The majority were 
Biology students, and the remainder were scattered among Psychology, Chemistry, Geography, 
and Anthropology majors. 
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Ethics 

The instructor was the principal researcher on this study. A formal ethical review was conducted 
by the Ethics department of the university, and the study was approved. The students were 
informed of the study, the right to withdraw and informed consent was obtained by Danielle 
Truswell, a student assistant working in the class. She held all data about who were and who 
were not participants. The instructor did not see this information at any time. The data used here 
were not collected until after the class had ended and the final marks submitted so that nothing in 
the study could influence a student’s marks. 

There was little in the way of instructor bias to accommodate for in this study as the instructor 
had no idea what would be found, and therefore had little in the way of preconceptions. The data 
used were quantitative and collected automatically by the online system. 

Results 

The Progress of the Class 

Figures 1, 2, and 3 show the growth of the KF database in terms of total notes contributed 
(new notes, responses, and others) for the science class. 



Time in days 


Figure 1 . Cumulative Number of Notes Posted in KF During the Term. 


As can be seen in Figure 1, there was a difference in contribution rates in the second half of the 
term compared to the first half. Figures 2 and 3 give more detail. 
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Time in days (first half of the term) 


Figure 2. Cumulative Note Contributions for the First Half of the Term. 



Time in days (second half of the term) 


Figure 3. Cumulative Note Contributions for the Second Half of the Term. 


The contribution rates in Figures 2 and 3 are close to linear. Trend lines were added to the 
figures and analyzed. In the trend line equations in Figures 2 and 3, the number preceding “x” 
gives the slope of the line, which in this case is a measure of the average daily contribution rate. 
In Figure 2, the slope is 9.8 notes per day; in Figure 3, the slope is 28.11 notes per day. For the 
second half of the term, the contribution rate was nearly three times that of the first half. 
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Discussion of note contribution results. 

Two events contributed to the upswing in note contributions in the second half of the term. The 
first was that oral presentations began immediately following the mid-term break. During each 
class, there were four to five 20-minute oral presentations. A topic workspace created by the 
presenters and the other students could contribute with each presentation. In the first half of the 
term, the students only had one workspace per week to work in; now they had a number. 

The second event was that the instructor, having noticed that some students were not 
contributing very much, sent out an e-mail message to the class following the mid-term break 
reminding them that work in KF constituted 40% of their final mark. Included in the note was a 
graph showing relative contribution rates (names removed) so that the students could see the 
differences in contribution levels. They were reminded in the note that they had assessment tools 
available to allow them to examine their participation at any time. As well, the same information 
was presented in Knowledge Forum, and discussed in class. This was an attempt to present the 
students with timely formative feedback, but as can be seen, it had unexpected consequences that 
attenuated the hoped-for benefits of the feedback. 

The combination of these factors (plus experience with the system) appears to have catalyzed the 
upswing in contribution rate. However, as will be seen, this was not entirely successful in that it 
increased the students’ workloads, but did not have the desired result for some students. 

There was no evidence that the majority of students made use of the online assessment tools 
available. Many of the students seemed to be nonplussed when the mid-term results were shown 
to them, something that would not have happened if they had been using the assessment tools 
themselves. It is also probable that their workload would not have increased so much had the 
non-contributing students not suddenly started contributing. 


Participation patterns. 
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Figure 4. The Number of Note Postings Read by Each Student (sorted data.) 


Figure 4 shows the note reading pattern for the class. The highest-reading student read almost six 
times the number of notes as the lowest-reading student, a ratio of 6:1. 

The pattern for responding was similar, almost linear. However, the student who created the 
most responses created only two and a half times the number of responses as the lowest scoring 
student, a ratio of 2.5:1. This is less disproportionate than is the case for note reading. 

The student who read the fewest notes (student 16) was in the middle of the group for response 
contributions (at 63). Likewise the second lowest reading student (student 18) was also in the 
middle of the group for responding (59 responses.) Reading few notes, but responding more 
frequently is an indicator of a maladaptive learning strategy discussed in the next section. 

Note contributions also followed an almost linear pattern. The disproportion between highest- 
and lowest-contributing students was similar to that for responses at 2.7:1. Again students 16 and 
18, the lowest-reading students, are found in the middle of the group for notes contributions. This 
is another indicator of a maladaptive learning strategy. 

Discussion of contribution patterns. 

Contribution patterns indicate that some students were following a strategy of reading relatively 
few notes (thereby reducing their reading load), but contributing on a par with the middle of the 
group. This was true for both responses and new note postings. This pattern is problematic 
because these students may not be exposed to the full spectrum of ideas presented by the other 
students. It also raises the possibility that some students were posting notes without having read 
postings by other students. 

An examination of the reply ratio (a ratio of the total number of responses to new note postings) 
(Nagel, et al., 2009), and a comparison of this to social network data and contributions data 
indicated that some students were reading few notes, but posting almost as many replies as notes 
read (Philip & Truswell, submitted for publication). Thus the tripling of the number of notes read 
by the students indicated the use of maladaptive learning strategies used to lighten information 
overload. 

Figure 5 shows the note reading network that developed over the course of the term. In this 
sociogram, students are represented by squares, and the connections among them by lines with 
arrows. Larger node sizes indicate more frequent reading interactions (these students’ noted have 
been read frequently.) Arrows indicate who is reading and who is being read. Following social 
network conventions, an arrow pointing to a student means that the student from whose node an 
arrow is emanating has read a note or notes by a student to whose node the arrow points. Here, 
indegree centrality can be viewed as influence. 
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Social Network Analysis Results-Community Formation 



Figure 5. The Note-Reading Network (Indegree Centrality.) 

The strength of ties within a network is important in the nature of the information transferred. 
Both strong and weak ties are important in the transfer of information, but differ in the type of 
information transferred. Strong ties are characterized by a higher level of intimacy in the 
exchanges, more self-disclosure, emotional as well as instrumental exchanges, reciprocity in 
exchanges, and more frequent interactions (Haythomthwaite, 2002). The latter two are the most 
commonly measured in social network analysis, and those are what were used here. Weak ties 
are less frequent, often one-way, share fewer types of information (often simple, statable 
information) and are less supportive (2002). In this analysis, ties were characterized as weak if it 
was one-way and exchanges were infrequent. Strong ties among actors in a network (indicated 
by bidirectional arrows) are important in the spread of complex information (for example, tacit 
information); weak ties indicate the spread of simple information (facts and other statable 
information) (Haythomthwaite, 2002; Kavanaugh, Reese, Carroll, & Rosson, 2005; Ruef, 2002; 
White & Houseman, 2003). Figure 5 shows that most students are connected to the network and 
have strong tie relationships with other students. However Figure 5 shows four students who are 
peripheral to the network, and whose notes have been read infrequently by the other students. 
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This is something that should draw the instructor’s attention as it may indicate that the student is 
not engaging with the work of the community. 

As a default, a single interaction among individuals is enough to establish that a social tie exists. 
However by raising this threshold, it is possible to examine the network actors who interact the 
most frequently, and determine how robust the network is. In social network analysis, this type 
of analysis is called a /t-core collapse. For the purposes of this study, a network collapse was 
defined as the point when 50% of the network was disconnected. The /t-core collapse analysis 
found that the community was robust to the 60-event level-at least 50% of the students read 60 
or note postings by other students. A high level of note reading is considered one indicator of 
membership in a knowledge building community (Scardamalia, 2002). Details of the threshold 
analysis can be found in Exhibit 2 

(http://www.cilt.ca/index.php/cilt/article/downloadSuppFile/57 1/6) . 

Discussion of the social network analysis results. 

Community formation is an important element of participation in online classes. A knowledge 
building community “commits to producing valuable ideas for the community, and shares the 
collective responsibility for improving those ideas” (Cacciamani, 2010). What can social 
network analysis contribute to demonstrating this? 

The presence of connected clusters is a social network definition of community (Barabasi, 2002), 
and Figure 5 shows a high level of connectivity that proved robust to the sixty-event level for 
note reading-evidence of community formation, and characteristic of knowledge building 
communities (Scardamalia, 2002). The presence of reciprocal ties indicates the potential for the 
transfer of complex information. Therefore, in network terms, a note reading community formed 
with pathways for the transfer of simple and complex information. 

Social network analysis is silent as to the content of the interactions, so it is not possible from 
this analysis to definitively state whether or not a knowledge building community formed 
(despite the indicator above.) However note posting is necessary for ideas to be contributed, and 
note reading is necessary for those ideas to spread and be improved. Frequent reciprocal 
interactions indicate collective responsibility for the development of the community. The reading 
network demonstrates that notes were read frequently among the students, and that the pathways 
for the transfer of both simple and complex information were present. Therefore the social 
network analysis tells us that communication patterns consistent with the formation of a 
knowledge building community were present in this class. 

In terms of participation, which (noted earlier) enhances learning (Nagel et al., 2009), the SNA 
results show the levels and kinds of participation found among the students. All students 
participated, some more than others. There were no students isolated from the group. 

Conclusions 

The social network analysis demonstrated that a connected cluster formed, an indicator of the 
possibility of community formation, and was robust to the sixty-event level, an indicator of the 
formation of a knowledge building community. Both strong and weak tie interactions were 
present, providing evidence that the pathways were in place for a knowledge building 
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community to form. However, triangulating this with the results for contribution and note 
reading levels indicate that although the pathways were in place, knowledge building itself may 
not have proceeded as effectively as hoped. A deeper analysis would be needed to definitively 
demonstrate knowledge building. 

Limitations and Further Research 

This was a small class of twenty students and more research is needed in order to establish what 
is and is not normal for a third-year undergraduate science population. The use of grade-based 
incentives based on online participation and communication patterns (SNA) is not common, and 
further research is needed to establish exactly what forms of analysis are the most effective and 
fair. Hewitt (2004) comments that the term community refers to a broad range of social 
structures, noting, “Clearly, some kinds of community engagement offer more educational 
promise than others” (p. 2). One limitation therefore of these findings is that there was no class 
in which no grade-based incentives were used to compare with, and the level of engagement and 
knowledge building in such a class is open to speculation. It is likely that the networked 
communities would be different. As well, it is not possible to predict the levels of participation 
and engagement in very large classes from these results. 

It is also important to avoid information overload so that students do not resort to strategies that 
reduce their effective participation. Further research needs to be done on how get the students to 
actually use the assessment tools provided to conduct their own formative assessments. 

Proving that a knowledge building community has formed requires multiple analyses beyond 
what could be done with this class (due to ethical considerations.) Social network analysis cannot 
provide all of this. It can demonstrate community, as defined in network terms, and provides 
evidence of the patterns and frequencies of interactions among the community members. Social 
network data needs to be triangulated with other data to definitively demonstrate that a 
knowledge building community has formed. 
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